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© An interactive dynamic range adjustment system for printing digital images. 



© An interactive dynamic range adjustment method 
for printing digital images, and an implementation 
system, are disclosed. The method is based on 
experimental findings about visual photoreceptor ad- 
aption and human visual contrast sensitivity. The 
system adjusts the contrast of the low-frequency 
component only of the image, preserving (or if one 
wishes, enhancing) the high-frequency image com- 
ponent in its contrast The adjustment is controlled 
by a mapping curve which the user manipulates 
interactively. The simulated optical print image and 
the dynamic range adjusted image are displayed 
side by side on a monitor screen so that the user 
can make proper selection of parameters to achieve 
©the desired effect. For many images, the system 
^automatically computes good parameters and no 
UJ further adjustment is needed. 
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AN INTERACTIVE DYNAMIC RANGE ADJUSTMENT SYSTEM FOR PRINTING DIGITAL IMAGES 



The present invention is related to the field of 
digital image processing and, more particularly, to 
a system and associated software for interactively 
adjusting the dynamic range of digital images prior 
to printing. 

A portion of the disclosure of this patent docu- 
ment contains material to which a claim of copy- 
right protection is made. The copyright owner has 
no objection to the facsimile reproduction of any 
one of the patent documents or the patent disclo- 
sure* as it appears in the U.S. Patent and Trade- 
mark Office patent file, or records, but reserves all 
other rights whatsoever. 

One of the many surprises, to an amateur pho- 
tographer is the way a back-lit scene looks on a 
photographic print. To the best of his/her recollec- 
tion, in the original scene there was nothing like the 
huge brightness difference on the print between 
the highlight and the shadow on the subject's face. 
Our visual systems apparently do not process the 
flat two dimensional photographic print the same 
way as they do for the three-dimensional scene 
image, for this reason, one has to process the 
image in, a compensatory way before it is printed 
on paper in order to make it look like the original 
scene. Another problem with printing an image 
having a wide dynamic range in luminance on 
paper is the limitation inherent in any reflection 
material, that is, the narrow useful dynamic range 
is limited by flare light. t.. . . 

Since a good camera/film system can easily 
record a density range of 1.6 with a gamma equal 
to 0.65. the recorded useful exposure range is 
about 300:1. However, the density /ange on a pho- 
tographic print, over which we can easily see im- 
age detail is from 0-12 to 1.8, which gives a lu- 
minance range of 50:1. There is, more information 
on the film than can be effectively expressed on 
the print without some type of dynamic range com- 
pression. A common way to deal with this problem 
1 is. the darkroom burning and dodging operation, 
which is the process to change the local exposure 
on paper by moving, a piece of opaque material in 
front of it. This process essentially reduces the 
density difference between a region and its sur- 
round. It takes skill, patience, and time to produce 
a good print with such a process. 

If one can scan the film image to convert it to 
digital form, one can do similar types of manipula- 
tion faster and with more precise, controls witn the 
help of a high-speed computer. The .present inven- 
tion is an interactive dynamic range adjustment 
system with associated software which has been 
implemented on a workstation with a keyboard and 
a mouse for user input. For an image with a wide 



dynamic range, one cannot simply compress the 
image signal proportionally at every point because, 
by doing so, the processed image will look very 
"flat" and visually unacceptable. The basic idea is 

s to separate the image into its low frequency and 
high-frequency components, and only perform the 
compression on the low-frequency component. The 
invention relies on an understanding of the image 
processing of the human visual system when it is 

w dealing with a wide dynamic range scetne. 

The Simple analogy that our eye functions like 
a camera overlooks the enormous image process- 
ing going on in the retina and the brain. Not only 
can the eye adapt to see over a luminance, range 

is of at least a billion to one, but it also can give a 
fairly constant perception of color and brightness 
despite the large variation in the illumination, across 
th6 scene. 

One of the visual adaptation processes occurs 

20 in the photoreceptors. There appear to be two 
mechanisms that operate during photoreceptor light 
adaptation, allowing the cell to continue to respond 
from very dim light to very .bright light. First, when 
receptors are illuminated with continuous light, the 

25 membrane potential gradually and partially returns 
towards dark levels* bringing the receptor below its 
saturation level and making it capable of respond- 
ing to brighter light. Secondly, if the steady back- 
ground light intensity is increased, the receptor 

30 intensity-response curve shifts to the high-intensity 
range. In Figure 1. taken from Figure 7.14c of the 
Retina: An Approachable Part of the Brain, by J. E. 
Dowfing, Harvard University Press. 1987, the V-log 
I curves representing the peak responses . of gecko 

35 ' photoreceptors ! are illustrated for a dark-adapted 
state (DA) and first and second background inten- 
sities log I = -4.2 and -2.2. In photographic terms, 
the receptor essentially changes its film speed 
according to the background light intensity. If the 

40 ' background light is weak, it uses a high-speed film. 
If the background is very bright, it changes to a 
very low-speed film. However, this is ^different from 
photography because the change of film speed 
occurs locally on the same image, i.e., the retina 

45 uses different speed films at different parts of an 
' image. Applying the same idea to printing photo- 
graphic images, one can change the effective pa- 
*per speed at different parts of an image by com- 
puters. This is the central idea of. the present 

so invention. * 

There are two major questions one has to 
answer at this moment: 

- What size is the so-called background -that the 
photoreceptors are adapting to? , . • >, i 

- What characteristic of the background determines 
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the adaptation state? Is it the average irradiance. 
the average log irradiance, or something else? 

To answer the first question, one needs to 
understand roughly what adaptation does to the 
original scene irradiance image. Basically, the op- 
eration of adaptation is totake something out of the 
input stimulus, and what is taken out depends on 
what is being adapted to. If the adaptation. is to the 
average irradiance of the surrounding background, 
i.e., the average irradiance is used to shift the 
intensity-response curve of the photoreceptor with- 
out changing the curve shape, then the effect of 
adaptation is to reduce the incident light intensity 
by an amount which is a function f of the average - 
irradiance 'of the adapting, background. If f is a 
linear function, then the effect of adaptation is 
effectively a high-pass filter. The magnitudes of the 
low-frequency components of the input image are 
decreased. To be locally adaptive, the background 
cannot be the whole image. On the other hand, it 
has to cover a reasonably large area so that the 
cell will not "adapt out" the very fine image.- detail. 
In the extreme case, if a cell can adapt fully to a 
very tiny spot of light just covering its size, every 
cell Will have an identical response, and there will 
be no image left. In terms of; spatial frequency 
content, the smaller the area of the adapting back- 
ground is, this higher the affected frequencies will 
" be. Presumably, the' compromise must be made so 
that the trade-off between the visible ,-image detail 
and the adaptive dynamic range is optimal for the 
organism's survival. Any optical system is limited 
by diffraction and aberration on the high, spatial 
frequency end. For visual perception, there is also . 
good reason to be insensitive to ttoe low frequency 
variation so that slow changes in, illumination and 
surface honuniformity will ; not interfere .with the 
perception of a physical object as a whole. 
- If one assumes that the low frequency re- 
sponse of the human visual system is determined 
by' local adaptation along the visual pathway, in- 
cluding stages beyond the photoreceptor (e.g.. lat- 
eral inhibition in the neural pathway), then one can 
get a good measure of how large an equivalent 
area a receptor cell takes as its adapting back- 
ground by looking at the data for the human visual 
contrast sensitivity function* <CSF). For a human 
J eye with a 23 mm pupil looking at scenes of high 
' luminance, the peak sensitivity is. at about 5-8 
1 v cycies/degree. At 2.25 cycles per degree the sen- 
sitivity is roughly half the peak value. It will be seen 
" later from the data -set out in the Description of the 
Preferred' Embodiment that the optimal^ adapting 
field size for the dynamic range adjustment, of the 
present system has a close relation to* these num- 
bers. 

To answer the second question, one has to 
hypothesize the mechanism' in the center and its 



interaction with the surround along the visual path- 
way. If the strength of mutual inhibition depends on 
the output from each of the interacting neurons, 
and the neuron's response is proportional to the 
s logarithm of the incident light irradiance. then what 
determines the adaptation is more likely to be the 
average log irradiance than the average irradiance. 
The input, response function of a neuron or a 
photoreceptor is' usually nonlinear, and it seems 
io that for a relatively large range of input the 
photoreceptor response is roughly proportional to 
the. logarithm of the input intensity, rather than to 
the intensity itself. Based on this type of reasoning, 
the average density of the surround will be used to 
75 control the local adaptation in the dynamic range 
adjustment of the present system. However, it is 
not clear from a physical or a mathematical point of 
view whether average density is definitely a better 
choice than average exposure. 
20 From the above discussion, a dynamic range 

adjustment method can be presented as follows. A 
!' pixel in the input negative image (only the lu- 
minance, component) is at the center of an N by N 
block. Its final density on the print will depend on 
25 how bright its surround is, which is measured by 
the weighted average density of its N by N neigh- 
boring pixels (including itself). Usually, if its 1 sur- 
round is bright, the pixel will be printed darker, 
meaning that the cell has adapted to the bright 
30 surround. The way the pixel is printed darker is to 
subtract a fraction of the averaged surround den- 
sity from the pixel's input negative density (this is 
equivalent to shifting the photoreceptor's intensity- 
response curve to the right). Reducing the pixel's 
35 density is equivalent to reducing the pixel's original 
scene exposure, and when the reduced negative 
f density is finally mapped through the paper WogH 
curve, the pixeii is printed darker. If the fraction of 
the averaged surround density subtracted from a 
40 pixel i&. a constant, independent of the averaged 
density level, then the whole process is essentially 
' unsharp masking, or high pass filtering in density 
space. This is easily seen from the fact that the 
weighted averaging process is a low-pass filter 
45 and, if a constant fraction of the low-pass filter 
'image is subtracted tr6m the original image, the 
result is a High pass filtered version of the input 
image. The unsharp masking operation has been 
used under a different name in digital image pro- 
so cessing, the v homomorphic transform (see, for ex- 
ample, "Image Processing in the Context of a 
Visual Model," Proc IEEE. Vol. 60, No. 7, pp. 828- 
8*2,' July 1972) which has been shown to com- 
press the dynamic range of images. The operations 
55 of' unsharp masking and homomorphic transform 
' differ in their exact filter response .shape, because 
the formerls meant to be a sharpening operation, 
while the latter is a dynamic range compressor. 
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However, the subtracted fraction need not be a 
constant. It can and should be a function of the 
averaged density. It is precisely by controlling the 
functional shape that one can control where and 
how much one wants to compress and expand the s 
dynamic range of the printed image. A good way to 
exercise this type of control is to let the user 
manipulate this function interactively, looking at the 
density histogram and the processed image as 
feedback for adjusting the function parameters. w 

These and other objects of the present inven- 
tion will become more apparent when taken, in 
conjunction with the following description and draw- 
ings wherein like characters Indicate like parts, and r 
which drawings form a part of this application. 75 

Figure 1 is a chart illustrating curves for the 
peak responses of gecko photoreceptors plotted on 
log-log coordinates. ' 

Figure 2 is a block perspective diagram of a 
system for implementing the present invention. 1 ■ 20 

Figure 3 is a block diagram illustrating the 
function blocks of one embodiment of the present 
invention. 

Figure 4 is a block diagram illustrating the 
mapping of the low-frequency component of an 25 
input negative density to a CRT code value. 

Figure 5 illustrates the screen of a CRT 
monitoring device when implementing the present 
invention at an operating position. 

. Figure 6 illustrates an example of a dynamic 30 
range adjustment curve generated by the present 
invention. > 

Figure 7 is a block diagram modification of 
the block diagram of Figure 3 illustrating the func- 
tion blocks of a second embodiment of the inven- 35 
tion. 

A basic system of an interactive image proces- 
sor on which the present invention is implemented 
is illustrated in Figure 2. The basic components of 
such a system are ah image scanner 12 for con- 40 
verting an image 10 into electrical signals which 
may be analog or digital in nature. If analog signals 
are outputted by the image scanner 12. an analog- 
to-digital converter 14 is used to provide digital 
signals which are used by a processor 16. The 45 
processor contains memory, ALU, temporary regis- 
tersi and control circuitry for operating the proces- 
sor under software and user control. Expanded 
memory is provided with a disk memory 18. A high 
resolution terminal 30 provides the user with visual so 
information and a keyboard through which user 
information is directed to the basic system. -Addi- 
tional inputting devices can supplement the user 
keyboard. These devices may be, for example, a 
mouse 31 having activating buttons A, B and C, 55 
light pen and pad or joy-stick (not shown) for 
controlling a cursor. 

A printer 20 is connected to the processor 16 



and to the terminal 30 for receiving a processed 
digital image from the processor and for printing a 
hard copy of the image. 

Referring to Figure 3, digital signals represent- 
ing an input R,G,B f image are directed to an R. G, 
B to luminance and chrominance transformation 
matrix 100 wherein signals corresponding to a lu- 
minance image and a chrominance image are gen- 
erated and appear at two different outputs. The 
luminance image signals are directed to the + 
input of a summing circuit 110'and to a low-pass 
(Gaussian) filter 120. The filter 120 provides a first 
output to a - input of the summing circuit 110 and a 
second output to a dynamic range adjustment 
curve block 140. The summer 110 provides at its 
output a difference signal which is the difference 
between the f luminance image signal and the low- 
, pass filtered luminance signal. The difference sig- 
nal is directed to an optional edge-sharpening and 
noise suppression block 130 which may be used to 
provide a curve for modifying the high frequency 
component of the difference signal. The output 
from block 1 30 is directed to one + input of a 
summing circuit 150 and the output of block 140 is 

. directed to a second + input of the summing 
circuit 150. The summing circuit combines the two 
signals on its. inputs and provides the cornbined 

> signals to an input of a luminance and chrominance 
to R.G.B transformation block 160. the transforma- 
tion block 160 also receives the chrominance sig- 
nals from block 100 at another input and trans- 
forms and combines the two signals to provide an 
R,G,B ( signal, to a paper shape curve block 170. 

s The paper, v shape curve block 170 functions to 
modify the R,G,B ; signals from transformation block 
1 60 by the characteristics of the paper upon which 
the image is t to be. printed. The output image 
signals are then directed to the printer 20 for 
printing. - 

The chrominance image may also be pro- 
cessed in a manner similar to the luminance image 
as illustrated in Figure 3. 

The paper shape curve block 170 can cause 
non-linear effects in the image which result in the 
chrominance image being altered by the improved 
luminance image. This alteration may be desired, 
or it may be unwanted. If it is unwanted, ther the 

:1 processing may be done according to the embodi- 
ment illustrated in- Figure 7. In this case^ the lu- 

. .minance image- is processed the same way as was 
illustrated in Figure 3 down through the summing 
circuit 150 (or 350 in Figure 7) while the chromin- 
ance image receives a different processing which 
prevents its alteration by the improved luminance 
image. Referring to Figure 7 beyond the summing 
circuit block 350, the luminance image is passed 
through a luminance paper shape curve block 360. 
The luminance paper shape curve block 360 func- 
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tions to modify the luminance signal by the char- 
acteristics of the paper upon which the image is to 
be printed. The input R.G.B image is put through 
the paper shape curve block 370. This paper shape 
curve block 370 functions to modify the original 
chrominance image as carried on the original lu- 
minance image by the characteristics of the paper 
upon which the image is to be printed. The R.G.B 
signals from the paper shape curve block 370 are 
then directed to the R.G.B to luminance trans- 
formation (matrix), function block 380 wherein sig- 
nals corresponding to a luminance image and a 
chrominance image are generated. Only the 
chrominance image signal appears at the output of 
block 380. The chrominance image from block 380 
and the luminance image from block 360 are re- 
combined in the luminance/chrominance to R.G.B 
.transformation (matrix) block 390. This transforma- 
tion block. 390 recreates the R.G.B image required 
for the printing device. All of the above may be 
implemented with the processor 16 operating under 
. software, control. ' 

The. present invention is concentrated on the 
manipulation of the curve which is used to modify 
the low-frequency component to achieve the dy- 
namic range adjustment, shown in Figure 3 as 
block 140. This curve will b<* called the dynamic 
range adjustment curve. The" input low-frequency 
component from the low-pass filter 120 is mapped 
/through the curve to a density space called the 
normalized density (see Figure' 6); which means 
that a density is not only contrast adjusted, but also 
density' balanced in the sense 1 that a fixed^normal- 
ized density is always ' mapped td } B r fixed paper 
density. In particular, the normalized density of 
1.28 is mapped to status A density of 0.8 on the 
paper. . 

The main questions for any implerrtentation are 
what type of weighted average Should be used, 
and how large should its support be. Since a Gaus- 
sian filter (or the difference of Gaussiahs) is often 
used in psychophysical" experiments to fit the 
shapes of the spatial frequency channel of the 
human visual system, and since it has a smooth 
shape (a smooth shape being necessary to avoid 
ringing artifacts), it is chosen as the low-pass filter 
120 for this application. The choice of filter size is 
not so obvious. Two approaches are possible. One 
is, to process the same image through the system 
with filters of many different sizes, and let a group 
of, people choose from them the best looking* one. 
The. other is to choose a filter size which will&ive a 
final frequency response similar to the low-frequen- 
cy portion of the human contrast sensitivity func- 
tion, as described in the previous sefction. * 1 

in the preferred embodiment' of the invention,: 
digital images were scanned from 35 mm • nega- 
tives (36 mm by 24 mm in dimension). They were 



all of the same size: 1932 by 1308 pixels. For a 
typical 35 mm camera with a focal length of 50 
mm, the angle of view is about 39.6 degrees in 
1932 pixels. There are 46.8 .pixels per degree at 
s the center. A Gaussian filter with standard deviation 
= a pixels has a half height response frequency of 
0.1874/q cycles/pixel. If the half height frequency 
for the human contrast sensitivity function is 2.25 
cycles/degree, which corresponds to 0.0481 
io cycles/pixel, then a proper size of the Gaussian 
filter is o.= .0.1874/0.0481 = 3.90 pixels. This 
somewhat simplified calculation shows that the 
. best print should be around o = 4.0 pixels. Note 
that one of the goals of the system is to make the 
75 print look like the scene as the human visual sys- 
tem sees -it. The .image processing is therefore 
trying to duplicate the visual processing that occurs 
when viewing the original scene, not when viewing 
the print, and it is the scene viewing condition 
20 which is important, not the print viewing condition. 
Therefore, -the,, abpve calculate^ .result should be 
dependent on the film size and the camera focal 
.. length, but not too much on" the print viewing 
distance and printer/scanner MTFs (modulation 
25 transfer functipn). Qf course, the scanner MTF can 
affect the frequency, consent of the scanned image, 
and can be the dominating factor ..when it is affect- 
ing the spatial frequencies lower than 8 
cycles/degree, (peak visual sensitivity) in the^origi- 
30 nal scene, or 0.171. cycles/pixel on .the scanned 
image., or 9.2 pycles/mm on the negative. Since a 
typical 35 mm negative. film has an "MTF" of 0.5 at 
30 cycles/mm or more, a scanner MTF should 
i have an MTF value almost equal to 1.0 at 9.2 
as cycles/mm. otherwise the scanned image is prob- 
u.-ably too blurry to be useful. Although the print 
viewing distance determines the spatial frequencies 
of the image features, it seems that as far as tone 
scale is concerned, the images processed by the 
40 i system do not change their tone scale quality 
, much, if at all. when viewed>t different distances 
from 5 inches to 20 inches. Some image detail 
disappears at a large viewing distance, but the tone 
scale perception is not noticeably affected. Why 
45 this is so is not clear, but this observation seems to 
confirm the. above statement that the viewing con- 
dition is not very important in determining the filter 
size. One can only conclude that the brightness 
perception for a flat surface is relatively indepen- 
sc dent of spatial frequency. 

From the above discussion, the best choice for 
, the filter size is about a = .4.0 pixels. 

. However, since the low-frequency content of the 
*. image is degraded a little compared with the high- 
55 frequency components, the image tends to look 
somewhat harsher .than the optical. The current 
implementation has intentionally made it look softer 
by using a small o of 3.66 pixels, when convolving 
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with the full-size image. 

An interactive software program called LOFCA 
(low-frequency contrast adjustment) has been im- 
plemented on a SUN workstation, (a product of Sun 
Microsystems Inc.) using C language and the SUN- 
VIEW window package! The software program is 
set out in full in Appendix A. This section will 
describe the implementation of LOFCA * ' 

The most time-consuming operation in the al- 
gorithm is the Gaussian convolution with a 23 by 
23 mask (3a on each side). Although the mask is 
separable in x and y f it still takes about 6-8 min- 
utes on a SUN4/280 workstation with 32 megabytes 
of memory to finish a 1932 by 1308 image. It is, 
therefore, preferable to subsample or block-aver- 
age the original scanned image to reduce the size 
for the interactive processing. This will affect the 
judgment of image structure on the monitor screen, 
but seems to provide adequate images for contrast 
and tone scale judgment. The input image" (1932 
by 1308) is 4 by 4 block-averaged in film transmit- 
tance, reducing the size jo 483 by 327 pixels: A 
luminance image is created from the reduced 
R,G,B image by the weighting functiph: luminance 
= 3/8R + 4/8G + 1/8B. The following operations 
are done. by. LOFCA Program on an input image 
before the monitor screen displays the images for 
user interaction: 

- The luminance image is convolved with a 7 by 7 
Gaussian filter with a = 1 pixel to produce the low- 
pass image. This takes about 20 seconds on 
SUN3/260 with 8 megabytes and a floating point 
accelerator. 

- A high-pass image is also computed by subtrac- 
ting the low-pass image from the luminance image. 

- Both the low pass and the high-pass images are 
stored in memory as short integers (empirically this 
has been found to be the fastest data type for 
arithmetic operations on a SUN3/260). 

The low-pass image is mapped through the dy- 
namic range adjustment curve (implemented as a 
fook-up table 200, see Figure 4), and then added to 
. the high-pass image. The combined high-pass and 
adjusted low-pass image is directed to a paper 
shape curve (implemented as a look-up table 210) 
to produce the output image which, after going 
through a screen calibration table 220, is displayed 
on the monitor 30 for the. user to cbmpare with the 
simulated best optical print. 

- As soon as the user changes any parameter of 
the dynamic range adjustment curve, a new look- 
up table 200 is computed. The low-pass image is 
mapped through the new table and added to the 
high-pass image to produce a new output image, 
which is .then displayed. The whole process takes 
less than half a second, and the monitor image 
appears to change almost instantly*. 

- When the user decides that the output image is 



good, he/she selects the "output" button with the 
mouse 31 . and the program writes out the dynamic 
range adjustment look-up table 200, which is used 
to process the full sized image. 

s To speed up the processing of many images, 

one can have it processed in the background while 
manipulating the contrast of the current image, thus 
eliminating waiting time. 

One key component in the user interaction is 

w the screen calibration. It is very important to make 
the image on the monitor screen look like the final 
print on photographic paper. Otherwise, the user 
has to mentally correct- for the difference when 
looking at the displayed image on the 'monitor. The 

75 LOFCA Program provides a button for the user to 
adjust the calibration curve parameters. The cali- 
bration curve maps the normalized film density 
through the paper shape curve 210 and the monitor 
CRT characteristic function table 220 to the CRT 

20 code value, such that the displayed image will have 
the proper radiance at each pixel location to make 
it look like a print on paper. The deeper question of 
the human visual adaptation state when viewing the 
CRT monitor is not explicitly addressed in the 

25 calibration so. far. The goal is that if pixel P is to be 
printed at status A density 0.7 and pixel Q at 1.0, 
then the CRT screen should display P at twice the 
radiance as that of Q i(10 10 *° V 2). This only takes 
care of the physical calibration on a relative scale. 

30 The psychophysical calibration is much more in- 
volved and- the LOFCA Program lets the user ad- 
just two parameters of the calibration curve: the 
gamma of the CRT and the status A density to be 
mapped to the CRT ( code value 128 (shown as a 

35 CAL input 254 to look-up table 220). With these 
adjustments, the user must try many images be- 
fore he/she is preceptuaiiy calibrated. Referring to 
Figure 5i another help that the LOFCA Program 
provides is the capability to display, anywhere on 

40 the blank area of the image canvases 40 and 40 , 
20 step gray scales 42 and 42 starting from status 
A density 0.1 (actually 0.11, because this is the 
minimum density of the paper used) with an incre- 
ment of 0.1 . The gray scale is specified by clicking 

45 any two points outside of the image area, but within 
the canvas. If the user has difficulty judging the 
absolute brightness of an area in . the processed 
image, the gray scale helps make the absolute 
judgment into relative judgment, which is much 

so easier and more reliable. All these features are 
desirable for compensating for. the lack of control 
over the room lighting, monitor differences, and 
variations in individuals' perception... 

Figure 5 show the screen 50 when the LOFCA 

55 Program is run on a SUN workstation. There are 
four canvases and two panels: the optical print 
canvas 40, the output image canvas 40\ .the hist^ ^ 
gram canvas 45, the contrast curve canvas 
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optical control panel 47, and the contrast control 
panel 48. The optical print canvas 40 displays the 
simulated optical print 44, and the output image 
canvas 40' displays the processed image 44 . Both 
canvases are dimensioned as 512 by 512. and the 
program will not accept images larger than 512 on 
either side. The histogram canvas 45 displays the 
density histogram of the input image. The contrast 
curve canvas 46 displays the normalized density 
vs. input negative density curve (see Figure 6 for 
details about this curve), as well as the output 
status A density vs. input negative density curve. 
These curves have center segments highlighted: 
They correspond to me middle segment «of the 
dynamic range adjustment curve, specified by the 
pivot density and the pivot range, explained in 
more detai! later. The corresponding middle region 
of the histogram is also highlighted. 

the convention of the usage of the mouse 
buttons (shown in Figure 2) is as follows. The left 
mousb bution A is used to select items and set 
values! The right mouse button CMs used for clear- 
ing up the canvases.' For example, if the gray scale 
is not wanted, it can" be erased by clicking the right 
button of the mouse in the canvas you want to 
clear. The middle mouse button is not used in the 
current implementation. 

The density balance for the Simulated optical 
print * is done by adjusting the slider^ in the optical 
control panel 48. which has two sliders: one for 
status A density, and the other for transfer density 
(See Figure 5). On the right-hand side of each 
slider, thefe are two buttons- for incrementing ■+ 
and decrementing - the corresponding slider value 
by 1, for fine adjustment, while coarse adjustments 
are made directly to the sliders: The negative den- 
sity shown in the; transfer density slider is mapped 
to the status A density value- shown in the status A 
density slider. The sliders ' are selectively activated 
' and incremented by the use of a cursor. 

The contrast control panel 47 has six sliders 
and ten buttons, the displayed slider values are 
the real values multiplied by 100 (e.g, a slope of 
0.3 is displayed as 30. and a density of 0.8, 80). 
Again, on the right-hand side of each slider, there 
are two buttons for incrementing and decrementing 
the corresponding slider value by 1. 

- "status A density" slider 

- •'pivot density" slider 

- "pivot range" slider 

- "lower slope" slider * 

- "mid slope" slider * 

- "upper slope" slider 

- "input" button 

i «<», V, and "v" buttons for rotating the images 

- "SHOW" button * '"' ' 

- "Reset slope" button 

- "Cal" button 



- "SetROI" button 

- "Output" button 

- "Quit" button 

The "input" button will ask the user for the 
s name- of the next image to be processed. After the 
input image name is entered, the program com- 
putes the low pass and the high-pass images. It 
takes roughly 20 seconds for the SUN3/260 before 
the processed image and the simulated optical 
to print are displayed on the monitor screen. 

The dynamic range adjustment curve is initial- 
ized to be- a straight fine, which is determined by 
its slope and one point for density balance. From 
the paper curve, one can estimate the negative 
75 density range which : can be printed between 0.12 
and 1.8 .paper, density. This range is called the 
usable negative. density range, and is estimated to 
be 0,9.. The first and the 99th percentile densities 
of the input image density histogram are called 
20 dmin and dmax. The initial slope is estimated to be 
0.9/(dmax - dmin +, 0.01) and the initial density 
balance point is to map (dmin + dmax)/2 to the 
normalized density 1.28. which is then mapped to 
status A .density 0.8. The initial estimated slope 
25 value is limited to be less than 1.26 and greater 
than 0.65. These two limits were empirically deter- 
mined after printing many images. In general/if the 
^slope value exceeds this range, the image tends to 
look artificial. These initial estimates frequently 
30 need no further interactive adjustments. 

Referring now to Figure 6 and Figure 4. the 
dynamic range adjustment curve is a piecewise 
linear, curve, usually having three segments. The 
middle segment is determined by its slope and 
35 center point. The slope is controlled by the "mid 
slope" slider 250. and the center point is controlled 
by the "pivot density" slider 244 and the "status A 
density" slider 240. The length of the middle seg- 
ment is controlled by the "pivot range" slider 246. 
40 The upper and the lower segments are always 
connected tp the' end points of the middle seg- 
ment and thus have only one degree of freedom. 
The user can change the slopes of the* upper and 
. the. lower segments by moving the "upper slope" 
45 and "lower slope" sliders 252 and 248, respec- 
tively. 



The rotation buttons 



and n >° are 



usedi for rotating the images on the screen. The 
arrows indicate the current direction of the top of 
so ^ the image. For example, if the currently displayed 
image is upside down, the "v" button should be 
used to bring it right side up. 

The "SHOW" button allows the user to display 
' the locations of the pixels which have density val- 
55 ues within a specified range. The range can be 
specified eitherof two ways. The first way is to use 
the "pivot density" and the "pivot range" ■ sliders 
244 and 246, respectively. The second way is to 



7 



13 



EP 0 377 386 A2 



14 



move the cursor to the histogram canvas 45 and 
use the mouse 31 to click the beginning and the 
end densities to specify the range. The pixels 
within the range will show up on the optical print 
canvas 40 as white, and the rest as black. The 
"SHOW" button is a toggle switch which allows the 
user to alternate between the simulated optical 
print 44' and the pixel locations. The use of the 
histogram canvas 45 and the pixel location image 
is the most effective way to determine which areas 
of the input image 44 have certain specified den- 
sities. One example is for printing a flash-in-the- 
face scene. The histogram is usually bimodal. The 
user can use the mouse 31 to specify the density 
range around a histogram valley 49 and use the 
"SHOW" button to see if those pixels all fall on the 
boundaries of objects/ If yes, one can compress 
that density range quite freely without worrying too 
much about, possible artifacts (but riot below 0.3). 

The "Reset slope" button is useful when the 
user has gone too far in changing the slope values. 
The button will bring all the slope values to the 
initial values estimated by the program. The "Car 
button 254 will prompt the user in a dialog mode 
for changing the CRT gamma and the status A 
density to be mapped to CRT code value 128, to 
adjust the monitor calibration. The "SetROr button 
24£ is another way to specify the middle segment 
of the dynamic range adjustment curve. One can 
move the cursor 43 to the histogram canvas 45 and 
specify the two end points of the middle segment. 
One then hits the "SejtROI" button 242 to change 
the pivot density and the pivot range to that speci- 
fied in the histogram canvas 45. In doing so, the 
LOFCA Program tries to maintain rbughly the same 
density balance by estimating what new status A 
density the new pivot density should be mapped 
to. .' / 

When the user is done with the current image, 
he/she selects the "output" button to specify the 
file name where all the parameters are to be 
stored. The "Quit" button terminates the program 
immediately. 

One final feature applies to both of the image 
canvases. If the cursor 43 is moved to the image 
area and the left button A of the mouse 31 is 
clicked, the program Will take a 5 by 5 average of 
the input densities centered at the location where 
the cursor 43 points, arid print out the value as well 
as the (x,y) coordinates and the status A density to 
which the average value is mapped. If the cursor is 
in the output image* area, the averaged value is 
also marked in the histogram canvas, so that the 
user can see where in the histogram that density 
falls relative to the whole image. 



Claims 



1. An interactive dynamic range adjustment 
method for digital images comprising the steps of: 

(a) converting a digital image into luminance 
5 image signals and chrominance image signals; 

(b) separating the low frequency compo- 
nents from the luminance image signals; 

. -■ (c) modifying, interactively, the separated 
. low frequency components of the luminance image 
70 signals by a mapping curve to a density space; 

(d) recombining the modified separated low 
.frequency components to the luminance signals of 
step (b); and 

(e) converting and combining the. resultant 
rs luminance signals of step (d) with the chrominance 

image signals of step (a) to provide an interactively 
adjusted digital image. 

2. The interactive dynamic range adjustment 
method for digital images according to claim 1 and 

20 further comprising the steps of; 

displaying the original digital image; 

displaying the interactively adjusted digital image 

signal; and 

displaying the mapping curve of step (c). 

25 3. The interactive dynamic range adjustment 

method for digital images according to claim 2 
wherein the displayed mapping curve is a piece* 
wise: linear, curve having three segments, a lower 
: slope, mid-slope and upper slope with the ends of 

30 the mid-slope segment having one end connected 
! . to an end of the lower slope segment and its other 
end connected to an end of the upper slope seg- 
ment. 

4. • The interactive dynamic range adjustment 
35 method for digital images according to claim 2 and 

: further comprising the steps of: 
displaying a density histogram of the original im- 
age; and 

displaying interactive values for operator modifica- 
40 tions. 

5. The interactive dynamic range adjustment 
method for digital images according to claim 2 and 
further comprising the steps, of: , 

modifying the interactive adjusted digital image by 
45 a display device curve to display the interactive 
adjusted digital , image as it will be printed on 
. paper. . 

: 6. The .interactive dynamic range adjustment 
method for digital images according to claim i and 
so further comprising the steps of: 

modifying the provided interactively adjusted digital 
♦ image of step (e) by mapping the adjusted digital 

image through a paper shape curve. 
, . 7. The .interactive dynamic range adjustment 
55 method . for digital, images according to claim 1 
wherein step (c) modifies the separated low fre- 
quency components by contrast adjustment and 
density balance. 
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8. An interactive dynamic range adjustment 
method for a digital image comprising the steps of: 

(a) converting R.G.B digital image signals 
into luminance image signals and chrominance im- 
age signals; 

(b) low-pass filtering the luminance image 
signals to provide low frequency component lu- 
minance image signals; 

(c) subtracting the low frequency component 
luminance image signals from the luminance image 
signals to provide high frequency component lu- 
minance image signals; 

(d) modifying, interactively, the low frequen- 
cy components of the luminance image signals by 
mapping through a mapping curve to a density 

space; , 1 

(e) modifying the high frequency component 
luminance image signals by a desired mapping; 

(f) recdmbining' the modified low frequency 
and high frequency components of' the luminance 
image signals of steps (d) and (e); and 

(g) converting the recombined luminance im- 
age signals of step (0 and the chrominance image 
signals of step (a) to R.G.B signals to provide an 
interactively adjusted digital image. * ; 

9. The interactive dynamic 7 range 'adjustment 
method for digital images according to claim 8 and 
further comprising the step of: 1 ; . . . 
modifying the provided interactively adjusted digital 
image of step '(g) by mapping the adjusted digital 
image through a paper shape curves . : 

10. the interactive dynamic range adjustment 
method for digital images according to claim 8 
wherein step (d) modifies the separated low fre- 
quency components by contrast adjustment and 
density balance. 

11. The interactive dynamic range adjustment 
method for digital images according to claim 8 and 
further comprising: 

displaying the original digital image; 

displaying the interactively adjusted digital image 

signal; "and 

displaying the mapping curve of step (d); • 

12. The interactive dynamic range adjustment 
method for digital images according to claim 8 
'wherein the displayed mapping curve is a piece- 
wise linear curve having three segments, a lower 
stope, mid-slope and upper slope with the ends of 
the mid-slope segment having one end connected 

~ to an end of the lower slope segment and its other 
end connected to ah end of the upper slope seg- 
ment. ;i ' ' 

13. An interactive dynamic range adjustment 
method for digital images comprising the steps of: 

(a) converting an R.G.B digital image signal 
into luminance signals and chrominance image sig- 
nals; , 

; (b) low-pass filtering the luminance image 



signals to provide low frequency component lu- 
minance image signals; 

(c) subtracting the low frequency component 
luminance image signals from the luminance image 

s signals to provide high frequency component lu- 
minance image signals; 

(d) modifying, interactively, the low frequen- 
cy components of the luminance image signals by 
mapping through a mapping curve to a density 

70 space; 

(e) recombining the modified low frequency 
and high frequency components of the luminance 
image signals of steps (c) and (d); and 

(f) converting the recombined. luminance im- 
75 age signal of step (e) with the chrominance image 

signals of step (a) to provide an interactively ad- 
justed R;G.B digital image. 

14. The interactive dynamic ,range adjustment 
. method ( for digital images according to claim 13 
20 and further comprising the steps of: 

modifying, the provided interactively adjusted R.G.B 
■ digital image of step, (f) by mapping the adjusted 
R.G.B digital image through a paper shaipe curve. 
* 15. The* interactive dynamic range adjustment 
25 method for digital, images, according to claim 13 
wherein step ..(d) modifies trie separated low fre- 
quency components by contrast adjustment^ and 
density balance. , . . . , ■ . ^ 

16. The . interactive dynamic range adjustment 
30 method for. .digital images according to claim 13 

and further comprising: ' , 
displaying the original digital image; 
; displaying the .{digital image corresponding ta the 
.interactively adjusted R.G.B digital image;" and 
35 displaying the mapping curve of step (d). 

17. The interactive dynamic range adjustment 
method for digital images according to claim 16 
wherein the displayed mapping curve is a piece- 
wise linear curve having three segments, a lower 

40 slope, mid-slope and upper slope with the ends of 
the mid-slope segment having one end connected 
to an- end of the. lower slope segment and its other 
.. end connected .to an end of the upper slope seg- 
ment 

45 18. The. interactive dynamic range adjustment 

method for digital images according to* claim 13 
and further comprising the steps of: 
displaying .the density histogram of the original 
. . digital. image; and 

so . displaying interactive values for operator modifica- 

■■ -tion.. / % . 

.: 19. The interactive dynamic range adjustment 
method for digital images according to claim 13 
. and. further comprising the step of modifying the 
55 interactive by adjusted digital R.G.B image by a 
display device curve, to display the interactively 
adjusted digital image as it will be printed on 
paper. 
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20. An interactive dynamic range adjustment 
method for digital images comprising the steps of: 

(a) converting an R.G.B digital image signal 
into luminance image signals; 

(b) low-pass filtering the luminance image 
signals to provide low frequency component lu- 
minance image signals; 

(c) subtracting the low frequency component 
luminance image signals from the luminance image 
signals to provide high frequency component lu- 
minance image signals; 

(d) modifying, interactively, the low frequen- 
cy components of the luminance image signals by 
mapping through a mapping curve to a density 
space; 

(e) recombining the modified low frequency 
and high frequency components of the luminance 
image signals of steps (c) and (d); 

(f) mapping the recombined modified low 
and high frequency components of the luminance 
image signals of (e) through a paper shape curve; 

(g) mapping an R.G.B digital image signals 
of step (a) through a paper shape curve; 

(h) transforming the mapped R,G,B signals 
of step (g) into chrominance image signals; 

(i) combining the luminance image signals of 
step (f) and the chrominance image signals of step 
(h); and 

(j) transforming the combined signals from (i) 
to R.G.B image signals to provide an interactively 
adjusted digital image. 

21. The interactive dynamic range adjustment 
method for digital images according to claim 20 
wherein step (d) modifies the separated low fre- 
quency components by contrast adjustment and 
density balance. 

22. the interactive dynamic range adjustment 
method for digital images according to claim 20 
and further comprising: 

displaying the original digital image; 
displaying the digital image corresponding to the 
interactively adjusted digital image signal; and 
displaying the mapping curve of step (d). 

23. The interactive dynamic range adjustment 
method for digital images according to claim 22 
wherein the displayed mapping curve is a piece- 
wise linear curve having three segments, a lower 
slope, mid-slope and upper slope with the ends of 
the mid-slope segment having one end connected , 
to an end of the lower slope segment and its other 
end connected to an end of the upper slope seg- 
ment. 

24. The interactive dynamic range adjustment 
method for digital images according to claim 20 - 
and further comprising the steps of: 

displaying the density histogram of the original 
digital image; and 

displaying interactive values for operator modifica- 



tion. 

25. The interactive dynamic range adjustment 
method for digital images according to claim 20 
and further comprising the step of modifying the 

s interactive adjusted digital image by a display de- 
vice curve to display the interactive adjusted digital 
image as it will be printed on paper. 

26. An interactive dynamic range adjustment 
system for digital images comprising: 

10 . (a) transformation means (100) for converting 

a digital image into luminance image signals and 

chrominance image signals: 

, (b) filtering means (120) connected to said 

transformation means for separating the low fre- 
75 quency components from said luminance image 

signals: 

(c) dynamic range means (140) for modify- 
ing, interactively, the separated low frequency 
components of said luminance image signals by a 

20 mapping curve to a density space;, 

(d) means (110, 130. 150) for recombining 
the modified* separated low frequency components 
with said luminance image signals; and 

(e) means (160) for combining and convert- 
25 ing the signals from said recombining means with 

the. chrominance image signals from said trans- 
formation means (100) to provide ah interactively 
adjusted digital image. 
. :i 27. The interactive dynamic range adjustment 
30 system for digital, images according to claim 26 
and further comprising: 

paper, curve means (170) for modifying the pro- 
vided interactively adjusted digital image to adjust 
for print paper responses. 
35 . 28. The interactive dynamic .range adjustment 
system for digital images according to claim 26 
( wherein said dynamic range means (140) is a prog- 
rammable look-up table (200). 

29. An interactive dynamic range adjustment 
40 system for digital images characterized by: 

(a) first transformation means (100) for trans- 
forming digital R.G.B image signals into luminance 
image signals and chrominance image signals; 

(b) , low-pass filtering means (120) for receiv- 
45 ing the luminance image signals from said trans- 
formation means (100) to provide low frequency 
component luminance image signals; 

?{c) first summing means (110) for subtracting 
: the, low. frequency component- luminance image 
so . signals from the luminance image signals to pro- 
vide high frequency component luminance image 
.signals; , ; v 

(d) dynamic range adjustment means (140) 
for modifying, interactively,, the low frequency com- 

55 > ponents of the luminance image signals from said 
first transformation means by mapping to a density 
space; j . • \ / 

(e) means (130) for edge sharpening 1 and 
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noise suppressing the high frequency component 
luminance image signals from said first transforma- 
tion means; 

(f) second summing means (150) for recom- 
bining the modified low frequency and high fre- 
quency components of the luminance image sig- 
nals; and 

(g) second transformation means (160) tor 
receiving the recombined signals from said second 
summing means (150) and the chrominance sig- 
nals from said first transformation means (100) to 
provide an interactively adjusted digital R.G3 im- 
aoe 

30. The interactive dynamic range adjustment 
' system for digital images according to claim 29 

and further comprising: ' 

paper curve means (170) for modifying the pro- 
vided interactively adjusted digital R.G.B image by 
mapping the adjusted digital R.G.B images through 
a paper shape curve. 

31. An interactive dynamic range adjustment 
system' for digital' images characterized by: 

" (a) first transformation means (300) for trans- 
forming digital R.G.B image signals into luminance 
image signals arid chrominance image signals; 

(b) low-pass filtering means (320) for receiv- 
ing the luminance image signals from said trans- 
• formation means (300)' to provide- lew frequency 
component luminance image sigrials; 

. (c) first summing means (310) for subtracting 
the low frequency component luminance image 
signals from the luminance image signals to pro- 
vide high frequency component luminance image 

signals; ,*Am 
' (d) dynamic range adjustment means (340) 
. for modifying, interactively, the low frequency com- 
ponents of the luminance image signals from said 
first transformation means by; mapping to a density 

spape.^ means (330) . f 0r edge sharpening and 
noise suppressing the high frequency component 
luminance image signals from said first transforma- 
tion means; 

(f). second summing means (350) for recom- 
bining the modified low frequency and high fre- 
quency components of the luminance image sig- 

" aS " (g) paper curve means (370) for modifying 
digital R.Gi image signals by mapping 'the digital 
R.G.B image signals'through a paper shape curve; 
(h) a second transformation means' (380) tor 

'transforming the mapped digital R.G.B image sig- 
nals from said paper curve means (370) into 
chrominance image signals; 

• (i) a luminance 5 paper shape' curve means 
(360) for modifying the provided summed signal 
' from said second summing means (350) by map- 
ping the provided summed signal through a paper 



shape curve; and 

(j) third transformation means (390) for re- 
ceiving the chrominance signals from said second 
transformation means (380) and the mapped sig- 
nals from said luminance paper shape curve 
means (360) to provide an interactively adjusted 
digital R.G.B image. 
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0 An interactive dynamic range adjustment method 
for printing digital images, and an implementation 
system, are disclosed. The method is based on 
experimental findings about visual photoreceptor ad- 
aption and human visual contrast sensitivity. The 
system adjusts the contrast of the low-frequency 
component only of the image, preserving (or if one 
wishes, enhancing) the high-frdquency image com- 
ponent in its contrast The adjustment is controlled 
by a mapping curve which the user manipulates 
interactively. The simulated~ : optical' print image (44) 
and the dynamic range adjusted image £44') are 
displayed side by side on a monitor screen (30) so 
that the user can make proper selection of param- 
eters to achieve the desired effect! For many im- 
ages, the system automatically computes good pa- 
rameters and no further adjustment is needed. 
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